240 




IMAGE 
SEQUENCE 



CAMERA(S) 
-----I --- 



220- 



MV OUTPUT 
MODULE 



BACKGROUND 
DETECTION MODULE 



250' 



SPATIO/TEMPORAL 
SEARCH MODULE 



270 



PATTERN-BASED 
SEARCH MODULE 



4-. 



230 



MV RELIABILITY 
MODULE 



, m • - - * 



260 



4- 



• EVALUATED 



MVS 



ENCODER 
MODULE 



280 



FIG. 2 



310- 



(start) 



305 



•320 




STAGE 1: 
BACKGROUND DETECTION 



Yes 



325- 



SEARCH DONE: 
OUTPUT MVs 



•345 




STAGE 2: 
SPATIO-TEMPORAL 
CANDIDATE MV EVALUATION 



Yes 



SEARCH DONE: 
OUTPUT MVs 



340- 



Yes 



•370 



LARGE 
HEXAGONAL SEARCH 



SMALL 
HEXAGONAL 
SEARCH 



360-^ 



I 



SEARCH DONE: 
OUTPUT MVs 



^ 365 

STAGE 3: 
PATTERN SEARCH 



315 



260 



J* *\ 

\ EVALUATED J«— - 



375 



MVS 



Yes CURRENT 

MV ALREADY >«— 
%% * % EVALUATED,*** 



FIG. 3 



385 



± f. 

RETURN 



•PRIOR VALUES J 



r 



: No 
t..„. 

EVALUATE 



380 



CURRENT MV ; 









































































/ 
/ 




/ 
/ 
/ 
y 


77Z7 

/V7V 














? 

/ 
/ 


¥\ 

h 


/ 

/ 
/ 
/ 











































THREE TEMPORAL NEIGHBORS IN THE 
PREDICTION REFERENCE FRAME, t-1 

FIG. 4A 



























































\\\\ 








s 


c 

^5 




s 6 s 




\\\ 




\\\\ 


\\\\ 






\ 

s 


AW 


Mill 










S 4 


\ 
\ 
\ 


c 


\\\ 


INI 



















































FOUR SPATIAL NEIGHBORS IN THE 
CURRENT REFERENCE FRAME, t 



FIG.4B 




FIG. 5 



600- 



(start) 



210 




OUTPUT 
MV ESTIMATE FOR 
CURRENT BLOCK 





INPUT VIDEO 
OR IMAGE 
SEQUENCE 


605-^ 


r 


► 


FIRST STAGE 




MV ESTIMATES 


615 




r r 








COMPUTE 


X 


MV ERRORS 




200 



•610 



-635 



SECOND STAGE 
MV ESTIMATES 



620 



640 



IDENTIFY MV WITH 
MIN ERROR FOR 
CURRENT BLOCK 




645 



COMPUTE 
MV ERRORS 



655 



YES ^ MV 

RELIABLE. 

? 

660 



/MV *%„ 
NO y ALREADY 
" ^EVALUATED,*** 

v ? y 



•260 

» ~ ~ - - - - * 

EVALUATED }« — 



I GET MV 1 ; 
'1 ERROR J 

1 YES 



■ Mvs \ 



THIRD STAGE 
MV ESTIMATES 



IDENTIFY MV WITH 
MIN ERROR FOR 
CURRENT BLOCK 



r 



650 



COMPUTE 
MV ERRORS 



670 

NO X ALREADY \ 



665 



^EVALUATED,,' 



675 



680 



FIG. 6 



